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ABSTRACT 

A study investigated whether college environments 
known to provide unusually rich out-of-class learning opportunities 
are associated with different patterns of student learning and 
personal development. Data were gathered during a year-long 
examination of institutional conditions associated with student 
involvement in out-of-class learning opportunities at 14 colleges and 
universities (Iowa State University? Miami University, Ohio? Stanford 
University, California? University of California-Davis? Berea 
College, Kentucky? Earlham College, Indiana? Grinnell College, Iowa? 
Evergreen State College, Washington? University of 
Alabama—Birmingham? University of Louisville, Kentucky? University 
of North Carolina-Charlotte? Wichita State University, Kansas? Mount 
Holyoke College, Massachusetts? and Xavier University of Louisiana) 
of three types: small residential, large residential, and urban. 
About 1,300 staff, alumni, and trustees were interviewed and 3,603 
undergraduate students were surveyed. Four conclusions are drawn: (1) 
the small residential college environments were associated with 
patterns of student learning that differed appreciably from both 
types of larger institution? (2) for students at large institutions, 
one's peers seem to be as important to student learning as faculty? 
(3) a cumulative index of learning obfuscates the diverse patterns of 
learning and the influence of different environmental characteristics 
on learning? and (4) surrogate indices of institutional culture seem 
to be associated with student learning but in ways that are difficult 
to explain. Includes 33 references. (MSE) 



***»««««««««»«««««««******«*••••••••••••••••••••••••••••••••••••••••• 



• Reproductions supplied by EDRS are the best that can be made 

* from the original document. 




I^XM A&M University 



Department of Educational 



Admintstntion 
College Station. TX 77843 
(409) 845-0393 



ASSOCIATION FOR THE STUDY OF HIGHER EDUCATION 



This paper was presented at the annual meeting 
of the Association for the Study of Higher 
Education held at the Red Llon-Jantzen Beach 
in Portland, Oregon, November 1-4, 1990. This 
paper was reviewed by ASHE and was judged to 
be of high quality and of interest to others 
concerned with the research of higher education. 
It has therefore been selected to be included 
in the ERIC collection of ASHE conference papers. 



mc 




Influence of Collegiate Bnvironaenta on Student Learning 

Student learning in college occurs through associations with others 
(e.g., peers, faculty) in such settings as classrooms, athletic and 
recreational facilities, libraries, student residences, laboratories, fine 
arts facilities, and campus unions (Pace, 1988). These settings can be 
described in various ways: physical properties including the use of open 
space and the size, location, and use of buildings (Gerber, 1989); the 
aa^ience created by the behavior and personalities of students (Astin & 
Holland, 1961); the perceptions of students (Pace, 1984); the environmental 
"press" (Stern, 1970) or expectations established by dcminant student (Clark 
& Trow, 1966) or faculty groups; and the cultural elements of campus life 
consisting of patterns of norms, practices, syiri)ols, values, beliefs, and 
assumptions that guide the behavior of individuals and groups (Kuh & Whitt, 
1988). Hence, collegiate environments have important objective, physical 
characteristics as well as important subjectively perceived and experienced 
qualities (Baird, 1988; Huebner, 1979; Western Interstate Commission for 
Higher Education, 1973). 

A core assumption of ecological psychology is that people both shape 
their environment and are shaped by it (Banning^ 1975; Barker, 1963; Kaiser, 
1972; Wicker, 1979). Social learning theory (Bandura, 1977) suggests that 
people vary their behavior according to reinforcement consequences in their 
social and physical environments (Moos, 1976). Because environmental stimuli 
consistently elicit and reinforce certain behaviors, people tend to exhibit 
consistent patterns of behavior in particular settings (Barker, 1968). 

Of course, the characteristics of collegiate environments are not 
monolithic. Baird (1990) found that students at selective liberal arts 
colleges, on average, reported higher levels of involvement in different 
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learning activities compared with their counterparts at other types of 

institutions (general liberal arts colleges, comprehensive universities, 

doctoral universities). Pace's (1988) analysis of College Student JxBerience 

Questionnaire (CSBQ) data demonstrated that variation within categories of 

colleges (e.g., selective liberal arts, research universities) may be greater 

than b^ti#een categories. That is, students at some selective liberal arts 

colleges are more involved in learning activities than peers at other 

selective colleges. 

One could assume that differences in student behavior across colleges 

and universities may be, in part, a function of how college environments are 

arranged. Indeed, the ecological perspective on environments coupled with 

the college outcomes literature (e.g., Astin, 1977; Feldman & Newcomb, 1969) 

suggest that some colleges may discourage students from taking advantage of 

learning opportunities while other institutions may be more potent in 

clarifying and expressing their educational purposes, shaping desired 

behavior, and fostering interactions among people who are basically 

supportive of the institution's purposes (Baird, 1988). The institutions 

that participated in the College Experiences Study (Kuh, Schuh, Whitt, 

Andreas, lyons. Strange, Krehbiel & MacKay, 1991) are examples of the 
1 

latter. Students at these colleges provide a counterpoint to Baird' s (1990) 
observation that the undergraduate experience for many students is "a rather 
prosaic, uninvolved affair" (p. 277). 

Most of the studies that have examined the relationship between student 
learning and college environments employed pencil and paper instruments. For 
example, the aformentioned CSEQ provides useful measures of the campus 
environment, student learning, and the amount of effort students expend in 
various activities. However, as with all standardized pencil and paper 



instrunents, the information obtained is limited by the nature and scope of 
the questions. The Kuh et al. (1991) study is based on information gathered 
using qualitative methods. Such methods usually allow students i faculty and 
others to identify aspects of institutional life that they consider to be 
meaningful and important and produce dense, complicated descriptions of 
campus environments and institutional cultures. Howeveri a limitation of the 
Kuh et al. project is that they did not report what or how much students 
learned or whether certain environmental characteristics were associated with 
different outcomes or patterns of student learning. Knowledge about how 
institutional environments known to be relatively potent in their impact on 
students affect student learning should be useful for policy makers as well 
as faculty, staff and students committed to improving the quality of 
undergraduate education. 

Purpose 

The primary purpose of this paper is to determine whether collegiate 
environments known to provide unusually rich out-of-class learning 
opportunities are associated with different patterns of student learning and 
personal development. That is, are certain institutional characteristics 
(e.g., location and emphasis on scholarship, interpersonal relations or 
student responsibility) associated with different patterns of student- 
reported learning? 

Student learning is a value-added measure as it reflects students' self- 
reported g ains in learning and personal development. Although student effort 
is known to be an important variable in learning outcomes (Astin, 1985; Pace, 
1988), effort (involvement) is not introduced into the analysis because the 
interactions of environments, student effort and student learning are too 
complex to be addressed in a paper of this length. We acknowledge that 
student effort must also be considered to reach a more comprehensive 



understanding of how environaental conditions interacting with individual 
student variables (e.g., ability, effort) influence learning. In a 
subsequent paper we shall attenpt to estimate the relationships between 
institutional environments, student effort and student learning. 

A secondaiy purpose of the paper is to detemine whether cultural 
aspects of colleges and universities, discovered using qualitative methods, 
can enhance understanding of environmental influences on learning. That is, 
does informat ion about campus culture add to the explanatory power of the 
influence of the environment on student learning? Combining qualitative data 
about institutional culture with quantitative measures of student learning 
presents challenges. Transforming qualitative information into quantitative 
indices is viewed as abhorrent by some (many?!?) for several reasons: (a) it 
attempts to join two inquiry paradigms some believe to be disjunct (Clark, 
1985); (b) it does violence to the assumptions on which the original 
qualitative data collection was based; (c) it assumes that rich, complex, 
context-bound descriptions of complicated cultural elements of campus life 
can be reduced to to simple nximerical indices. 

Combining qualitative and quantitative methods (and their paradigms) is 
too complicated an issue to address here. We are certainly aware of the 
debate (Howe, 1988; Lincoln, 1986; Smith & Heshusius, 1986) and that support 
can be found for either position (assuming that only two positions are 
pertinent to make the point); that is, qualitative methods are grounded in a 
constructionist paradigm (Lincoln & Guba, 1989) while conventional 
quantitative methods are rooted in the agri-botany model of data collection 
and analysis. Our purpose here is simply to see whether some of the 
information obtained through qualitative methods can be used successfully to 
better understand aspects of the environment (e.g., culture) that cannot be 



(or have not been) estiaated using quantitative techniques (Jick, 1979). In 
addition, we expect that interpretations of the quantitative results of 
student learning and environmental characteristics fro« the CSEQ can be 
enriched by the contextual knowledge obtained through spending ti«e on the 
caapuses. 

Methods 

The infomtion on which this paper is based was gathered under the 
auspices of the College Experience Study, a year-long investigation of the 
institutional conditions associated with student involveaent in out-of~class 
learning opportunities at 14 colleges and universities (Kuh et al., 1991). 
Data Sources 

Participating institutions were identified with the assistance of 48 
experts drawn fron higher education scholars (e.g., Alexander Astin, Zelda 
Ganson, Robert Pace, David Riesaan), higher education associations (e.g., 
Aaerican Association for Higher Education, Aaerican Council on Education, 
Council of Independent Colleges), regional accreditation associations, 
selected college and university presidents, and fomer presidents of the 
Aaerican College Personnel Association and the National Association of 
Student Personnel Administrators. The study included large universities 
(Iowa State University, Miaai University, Stanford University, University of 
California, Davis), small liberal arts colleges (Berea College, Earlhaa 
College, Grinnell College, The Evergreen State College), and urban 
institutions (University of Alabaaa-Birainghaa, University of Louisville, 
University of North Carolina-Charlotte, Wichita State University). A women's 
college (Mount Holyoke College) and a historically black college (Xavier 
University) were also studied^ 
Data Collection 

As alluded to earlier, both qualitative and quantitative methods were 
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esployed. Qualitative nethods (i.e., interviews^ observations, document 
analysis) were used to discover and describe the institutions* culture and 
subcultures as well as other aspects of institutional life thought to be 
related to student learning (e.g., Mission and philosophy). About 1300 
people (175 faculty, 83 acadenic administrators including presidents » chief 
academic officers and registrars, 305 student affairs professionals, 644 
students, and 73 others such as alumni, trustees, librarians, and staff) were 
interviewed, some of them more than once. A detailed description of the 
qualitative methods employed is presented in Whitt and Kuh (in press). 

In addition to the qualitative data collection activities, the College 
Student Experience Questionnaire (CSEQ) was administered to 9445 randomly 
selected undergraduate students at 13 of the 14 institutions. Students at 
The Evergreen State College routinely object to, and in this case, refused to 
participate because they believe standardized instruments are not able to 
capture some of the more important dimensions of their education. Some 
universities have found that students of color tend to complete questionnaire 
surveys at lower rates than white students (Amos, 1990). Hence, oversampling 
of minority students was requested in order to increase the number of 
students of color among respondents. All the institutions but Xavier were 
asked to oversample students of color by a factor of two. In other words, if 
the student body included S% students of color, the sample drawn to receive 
the CSEQ reflected 12% students of color. 

Usable CSBQs were returned by 3603 students. The response rate to the 
CSEQ (38k, Table 1), although lower than desired, is not unusual for survey 
instruments of this type. In addition to oversampling students of color, the 
participation rate was further depressed by the inclusion of four urban 
institutions in the study. Only 31% of the students at urban universities 



responded; this low rate of return can be attributed in part to the fact that 
few students at these institutions live on caapus; most are older than 25, 
attend college part time, commute to class, and have many other activities 
(e.g., job, family, community responsibilites) that compete with responding 
to surveys. Also, student participation in survey research is notoriously 
low at Stanford, a condition to which we were alerted prior to the 
distribution of instruments. For example, responses to the annual Stanford 
Senior Survey, an activity to which the Stanford administration devotes 
considerable effort, yields only about 30* annually. In any event, because 
the CSEQ data will be used in concert with the institutional case reports 
based on the qualitative data, 3600 cases were deemed sufficient to examine 
the influence of the environment on patterns of student learning. 

Independent Vari^les. Two assessments of institutional environments 
were employed. The first is a measure of student perceptions produced by the 
eight CSEQ College Environment Scales which describe various characteristics 
of college environments (Appendix A). These are seven-point rating scales, 
with "7" defined as "strong emphasis" and "1" as "weak emphasis." Five of 
the rating scales refer to the extent to which the environment emphasizes 
certain aspects of student learning (scholarship, estheticism, critical/ 
analytical thinking, vocational competence, practical relevance of courses). 
The remaining three scales refer to relationships among students, faculty, 
and administrators. Positive relationships are defined by such words as 
friendly, supportive; approachable, helpful; considerate, flexible; the 
negative end is defined by such words as uninvolved, alienated; remote, 
unsympathetic; rigid, impersonal. 

As mentioned earlier, the characteristics of collegiate environments 
differ by such types of institutions as single-purpose liberal arts colleges 
and research universities. To produce the best models, data from the CSEQ 
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Enviromient Scales were analyzed by the three institutional types studied: 
sMll residential (fewer than 5,000 students); large residential (5,000 or 
■ore students); and urban (institucions located in metropolitan settings with 
a high proportion of part tine and coanuting students). 

The second measure of the environment was developed from Kuh et al. 
(1991) including the unpublished institutional reports for each of the 13 
institutions in the College Experiences Study that administered the CSBQ 
(Evergreen State excluded). The reports describe in varying detail the 
physical setting, campus culture (including history and traditions), policies 
and practices, and the role of institutional agents in promoting student 
learning. Six surrogate or "dummy'^ variables were derived from the 
qualitative data: 

(a) location — either "perceived" (e.g., Miami) or real isolation (e.g., 
Grinnell) (coded 1), near a metropolitan area (2), or city-based (i.e., the 
urban universities (3); 

(b) status — absence of status distinctions within the student body md 
between faculty and students (e.g., everyone is addressed by their first 
name, no fraternities on campus) (coded 1), the existence of status 
distinctions (e.g., fraternities are present but are not the dominant student 
subculture) (2), or an emphasis on status (e.g., persons are almost always 
addressed using titles, fraternity and other social groups tend to dominate) 
(3); 

(c) ethos — egalitarian (e.g., an emphasis on collaborative learning) 
(coded 1), aspects of both egalitarian ism and meritocracy (2), or 
meritocratic (e.g., an emphasis on competitive behavior) (3); 

(d) student life philosophy—autonomous ^e.g., students are expected to 
be responsible and self-directed) (coded 1), somehat structured (2), and very 



II 



structured (e.g., nunerous rules and regulations governing student life 
iaposed by the institution) (3); 

(e) strength of the institutional culture — weak (e.g., relative ly few 
pervasive cultural values and noras) (coded 1), sediua (2), and strong (e.g., 
numerous traditions, cerenonies, and rituals as well as binding behavioral 
noras) (3); and 

(f) enacted (not aerely espoused) comitaent to Bulticulturalisa — low 
(e.g., issues related to diversity and Kulticulturalisa are not eaphasized in 
the enacted aission, philosophy, policies and practices (coded 1), mediuB 
(2), and high (e.g., nuaerous references to Multicultural isB by institutional 
leaders undergrided by such policies and practices as the presence of ethnic 
these houses or culture centers and institutional financial aid targeted for 
students of color and other historically underrepresented groups) (3). 

In Table 2 the surrogate variable values for each institution are 
displayed. 

Dependent Variables. The 21 Estimate of Gains scales fron the CSBQ 
consist of student ratings of progress toward important educational goals 
(Appendix B). According to Pace (1988), these goals are frequently mentioned 
in the higher education literature and have been used in national surveys 
over the past several decades. The instructions for tins section of the CSEQ 
are as follows: "In thinking over your experiences in college up to now, to 
what extent do you feel you have gained or made progress in each of the 
follow respects?" The answers to be checked are "very little," "some," 
"quite a bit," or "very much." 

The question in the Estimate of Gains section ... is a 
value added question. It doesn^t ask students to estimate how 
much they have benefitted from college, or how well they can do 



crsrtain things, or h€^ such they know. It asks how much they have 
gained, how much they have added to their knowledge, their 
intellectuhl skills, and to other abilities and insights as a 
result of their experiences in college. 

... We know fr<»i both internal and external evidence that 
[students*] recall of activities and their estiaates of gains are 
credible, and that they respond carefully and perhaps in many 
cases with personal interest to the content of the questionnaire. 
Becat'se their responses are congruent with other judgaents, and 
because for soae goals the students say well be the only qualified 
judges of i^ether they are any different today than froa what they 
were when they arrived, we aust pay attention to what they say. 
(Pace, 1988, pp. 102-103) 

Data Analysis 

The relationships between the environaent and students* self-reported 
gains in learning and personal development were analyzed in two ways. First, 
a **grand gain score** (outcome) was created by adding the scores cf the 21 
Estimate of Gains scales. Second, to discover patterns of student learning 
associated with different collegiate environments, the 21 Estimate of Gains 
scales had to be reduced to a wieldy number. Four factor analyses were 
performed for this purpose. The first factor analysis included all 
respondents from all 13 institutions and resulted in five factors which were, 
for the most part, consistent with the factors reported by Pace (1987) (Table 
3). The only difference was that the five factors (pernonal/social — PERS & 
SOC; science/technology — SCI & TECH; general education, literature, arts — ED, 
LIT II ARTS; intellectual skills—INTBL SKL; vocational preparation--VOC PREP) 
were ordered somewhat differently for the institutions in this study: ED, 




LIT L ARTS; PERS & SOC, INTEL SKL, and VOC PREP. 

The factor analysis of gain scores by type of institution essentially 
reproduced the factors reported by Pace with three exceptions: (a) for large 
residential institutions Factors I (PERS & SOC) and II (SCI & TECH) were 
reversed; (b) for urban/coMuter institutions Factors III (ED, LIT & ARTS) 
and IV (INTEL SKL) were reversed; and (c) for small residential institutions 
a substantially different factor solution emerged (Table 3). For exaaplei 9 
of the 21 gains scales for students at aaall residential colleges loaded on 
the first factor (personal/inlellectual) . The difference in the factor 
structures of the gains scores between small residential institutions and the 
other types of institutions seemed significant enough so that for the 
regression analysis of the influence of mall residential environments on 
student learning the gains score factor solution for small residential 
institutions was used instead of the factor solution reported by Pace (1987). 

Regression analyses were conducted to determine the influence of 
collegiate environments on student learning at the three types of 
institutions. Fourteen independent variables were introduced into the 
regression: the eight CSEQ College Environment scales (Appendix A) and the 
six surrogate measures derived from Kuh et al. (1991) ^Table 2). Two sets of 
dependent measures were used: (a) the CSEQ Estimate of Gains grand gain 
score and (b) the factor solutions of the 21 Estimate of Gain scores for the 
respective type of institution (i.e., small residential, large residential, 
and urban/commuter) (Table 3). 

Results 

In general, the mean CSEQ Environmental Scale scores of the 13 
institutions in this study were higher than the mean scores provided by Fare 
(1987) (Table 4). Hence one of the assumptions on which this study was 
based — that the environments of this set of colleges are different frcMD those 
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at sinilar types of institutions — is supported by the CSEQ Environmental 
Scales. The exceptions include scale scores froa the urban institutions 
which usually fell between the m.jn scores for doctoral and coaiprehensive 
universities and the vocational and practical scale scores for small 
residential colleges. Comparing the urban institutions in this study with 
mean scores of doctoral and comprehensive institutions provided by Pace 
(1987) is inappropriate; neither the doctoral university or comprehensive 
university categories devised by Pace include more than a handful of 
institutions located in metropolitan settings which have a substantial number 
of part-time, commuter students (P. Lehmani personal communication » April 21, 
1990} • The vocational and practical scale scores for small residential 
colleges in this study fall somewhere between the means for selective and 
general liberal arts colleges provided by Pace (1987). This is to be 
expected as one of the small residential colleges, Berea, emphasizes the 
value and dignity of manual labor; the college requires that all students 
work. As a result, the practical and vocational scale scores are somewhat 
higher than what might be expected. 

The correlation matrix (Table 5) of Pace's environment scales and the 
surrogate variables suggest that they are generally independent environmental 
indices (i.e., not measuring the same thing). However, several of the 
surrogate variables are highly correlated (i.e., strength of the culture and 
location; ethos and status; commitment to multiculturalism and status and 
ethos) suggesting that these variables may be related to some underlying 
construct. The first two mtercorrelations are easy to explain. Older 
institutions tend to have stronger cultures; because most urban/communter 
institutions are younger — or their current organizational form and mission 
have changed in the recent past — their cultures tend to be less distinctive 
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and, hence» weaker. Ethos and status seem to be ■eaauring the saip: thing. 
The relatively high correlations between nulticulturalisn, statusi ethos^ and 
student life philosophy suggest that institutions characterized by 
egalitarisBy an absence of status distinct ionsi and expectations for student 
responsibility are more likely to have an enacted conitoient to 
■ulticulturaliSB (Tables 2 and 5). 

Bnvironaental scales from the CSEQ accounted for aore of the variance in 
the grand gain score of students at snail residential colleges and less at 
the larger institutions (Table 6). Although acadeaic/scholarly/intellectual 
(SCH) and esthetic (ESTH) CSEQ Bnvironaent Scale scores of the institutions 
in this study were relatively highi ^'hese environmental features were not 
relai:ed to the grand gain score. The aost iaportant environment variable for 
all three institutional types was the critical , evaluative and analytical 
(CRIT) dimension. In addition, neither the vocational nphasis (VOC) at 
small colleges nor the relationships with administrators (ADN) at the large 
institutions accounted for a significant amount of the variance in student 
learning. Only one of the surrogate environmental variables , institutional 
philosophy (PHIIX)S)» approached significance for only one type of 
institution — small residential colleges (i.e.i the more structured the 
environment^ the more students learned). Moreover^ relationships between all 
the environmental scales and student learning were positive (Table 6). 

However I when the factor solutions of the gains scales were used as the 
dependent variables » regression analysis revealed that the environments of 
the institutional types were associated with more diverse patterns of student 
learning. The amount of variance in the SCI & TECH gain factor accounted for 
by the environment for all three institutional types was so small (about 7- 
B%) that environmental effects on this factor will not be discussed. 

For small residential institutions, learning outcomes were generally 
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conBistent with the perceived influence of the environment. All but one of 
the CSB9 Environaent Scales contributed to intellectual and personal growth 
(Table 7). Recall that this factor is coaposed of nine scales distributed 
aaong three of the five gain factors reported by Pace (1987). The diverse 
scales reflecting both intellectual and personal development suggest that the 
environaents of sauill residential "involving colleges" arf) associated with an 
integrated^ holistic pattern of student learning. Institutional philosophy 
had a aodest influence on several gain factors (i.e., the acre structured the 
environaent, the greater the gains in health/teaawork, vocational coapetence, 
and art and literature) (Table 7). 

Soae of the relationships between the enviromrients of large residential 
institutions and student learning were predictable, others were surprising. 
CSEQ Environaent Scale scores were generally consistent with reported gains 
in learning and personal developoent. That is, students tended to report 
gains in areas eaphasized by their environaents (e.g., institutions perceived 
to eaphasize development of vocational skills and conpetence were associated 
with gains in this area) (Table 8). And, as one might expect given the size 
of these institutions, relationships with adainistrators were not 
significantly related to student learning; relationship^^ with students were 
positively related to gains in personal development. A structured campus 
environment (student life philosophy) was related to gains in personal 
develojnaent as well as intellectual development for students at the large 
residential institutions. For EO, LIT & ARTS, the magnitude of dependence on 
two of the surrogate variables was somewhat surprising. For exaaple, 
student-reported gaina in general education, literature and the arts appear 
to be most significant at institutions with an egalitarian ethos. More 
puzzling was the substantial association between a low enacted institutional 
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coHiiUient to BulticulturalisB (NULTIC) and gains in general educationi 
literature and the arts (Table 8). Because there is only one large 
residential institution with a low connitBent to nulticulturalisB (MiaBi)i it 
is possible that students at that institution report greater gains than their 
counterparts at the other large residential institutions. 

The influence of urban/conuter environnents on student learning was 
siailar in soae respects to those of large residential institutions (e.g., 
relationships between gains — particulrly PERS & SOC — and perceived enphasis 
on student and adainistrator relationships) (Table 9). T «e strength of the 
institutional culture was related to gains in personal developaent and in 
general education, literature and the arts; however , strength of the culture 
was not significantly related to student learning at either the snail or 
large residential institutions. Also, expectations for student 
responsibility and self-direction (autononous institutional student life 
philosophy) were associated with greater gains in personal development » 
general education and vocational competence (Table 9). 

Discussion and Conclusions 

Based on the findings, four conclusions are advanced with varying 
de rees of confidence. First, the environments of the small residential 
colleges in this study were associated with patterns of stude«it learning that 
differed appreciably from both types of larger institutions. Many observers 
(e.g., Heath, 1968; Keeton, 1971) have argued that institutions of higher 
education are more likely to have the desired impact on student behavior and 
learning when they present a coherent mission and philosophy. The data from 
the small colleges in this study lend support to the claim that coherence of 
educational purposf^s provides clearer expectations and produces outcomes 
(e.g., holistic learning) consistent with these purposes. 

Second, for students at large institutions, one's peers seem to be as 
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iiiportant to student learning in certain areas as are the faculty. While it 
was not surprising that relationships with students were related to gains in 
personal develoinnent (Tables 8 and 9), peers also influenced gains in 
intellectual developaent, general education and vocational skills. Thus, if 
one has a choice about where to go to college, estimating the quality of the 
students may be Just as critical as judging the coiipetence of the faculty. 

Third, a cumulative index of learning obfuscates the diverse patterns of 
learning and the influence of different environmental characteristics on 
student learning. Use of a grand gain score (sum of the CSEQ Estimate of 
Gains scale scores) to assess the influence of the environment on student 
learning across different types of institutions should be interpreted with 
caution. 

Fourth, surrogate indices of institutional culture seem to be associated 
with student learning but in ways that are difficult to explain. Part of the 
inability to provide tidy, convincing interpretations for why certain 
surrogate measures are linked to various gains in student learning is due to 
the simplification that results when complex cultural properties are 
transformed into numerical values. As we suggested earlier, it is possible 
that reducing complicated, holistic properties of institutional culture to a 
quantitative index does violence to the qualitative constructions on which 
descriptions of campus life are based. Also, the nuances of institutional 
policies and practices that reflect these surrogate cultural variables may be 
quite different depending on the institution's history, mission, and 
philosophy. For example, although both Miami and Xavier have a meritocratic 
ethos and use status distinctions in ways that are consistent with their 
espoused missions, the purpose, form and substance of institutional policies 
and practices differ considerably (Kuh et al., 1991). The majority of 
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students at Miani are froa the top quarter of their high school graduating 
classes and have relatively high entrance test scores; man} of the Xavier 
students — at least according to traditional indices — would not be eligible 
for admission to Niani. Yet, through of a series of pre-collegiate programs 
Xavier prepares students long before they matriculate for what will be 
expected of them in college enabling a higher percentage of th» to obtain a 
degree than would be predicted by their educational backgrounds. 

The surrogate measures do not correlate highly with the C SBQ Environment 
Scales; hence they reflect some different institutional qualities associated 
with learning. However, the absence of relationships between some suirogate 
variables and patterns of student learning warrants further examination. For 
example, neither strength of institutional culture nor institutional setting 
(e.g., isolated, city) were consistent predictors of gains in learning and 
personal development. One interpretation is that student learning is not 
limited by unalterable features such as the institution's location. Many 
students at urban/commuter universities do not have a choice about where they 
will attend college; their ir titution is "the only game in town.'' Students, 
faculty and administrators at urban institutions may find it reassuring that 
learning is Just as likely to occur in those settings as in isolated 
settings. 

It is possible that aspects of institutional culture may have an 
indirect influence on other variables related to student learning. For 
instance, the degree to which students feel connected to the institution may 
be associated with the amount of effort students expend in various activities 
related to learning. Another example is the messages sent by institutions 
with an egalitarian or collaborative ethos to students about the importance 
of working with others, in a subsequent paper, we shall attempt to determine 
whether indirect relationships exist between these surrogate variables and 

17 



patterns of student learning. 

The special qualities shared to varying degrees by the institutions in 
this study may have produced misleading results. These colleges and 
universities were included because they provided rich out-of-class learning 
opportunities for their students. On one hand, this selection criterion nay 
have attenuated soaewhat the variance in the CSBQ Environment Scale scores by 
raising the floor (i.e. , few low scores are reported which decreases the 
range between low and high scores in the sample). On the other hand, the 
surrogate vjriables created for the purposes of this study may have 
overestimated the actual variance within the sample. For example, all of the 
residential colleges and universities had more or less distinctive cultures. 
While some cultures of the institutions in this study may be **stronger" than 
others, the qualitative differences may not be as great as is suggested by 
surrogate variable values. Hence, some aspects of the learning environments 
of these institutions may appear to be more different than they actually are. 

Taken together, descriptions of institutional life created from the 
words of students, faculty and staff and results from the CSBQ provide a rich 
set of data pertaining to the undergraduate student experience. Anomalies in 
relationships between CSEQ Estimate of Gain scores and environmental 
characteristics may be better understood by an analysis of institution- 
specific patterns of learning outcomes coupled with information about the 
amount of effort students expend in activities related to the various 
domairs. For example, the variance in gains in the science and technology 
dcNMin was poorly explained by environmental variables. This finding 
warrants further investigation. Although combining quantitative and 
qualitative data presents problems , both are needed to understand the mutual 
shaping of student characteristics and institutional factors and conditions 



that foster student learning. 



End Note 

1 

Five categories of institutional factors and conditions were reported 
by Kuh et al, (1991) to be coHK>n to institutions reputed to provide high 
quality out-of-claas learning opportunities for undergraduates: (a) a clear, 
coherent aission and philosophy that coMunicate high but reasonable, 
challenges for students buttressed by an ethic of care; (b) institutional 
physical properties that are organized according to hunan scale principles 
and use the location (rural, near a city, surrounded by a netropolitan area) 
to educational advantage; (c) a complicated web of cultural artifacts 
(history, ayths, sagas, heroes/heroines, traditions, rites and rituals, 
subcultures, institution-specific language) (Kuh & Whitt, 1988) that values 
and encourages learning and coasunicates to students **how the institution 
works'*; (d) policies and practices that hold students responsible for their 
own behavior and learning, blur the artificial boundaries bet%#een in-class 
and out-of-class learning opportunities, distribute resources consistent with 
the institution's educational purposes, and enable sub-coHBunities of 
students to flourish, such as fraternities, ethnic theme houses, and acadeaic 
these houses; and (e) institutional agents who pr(»ote student participation 
in educationally purposeful out~of-class learning activities. 
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TABLE 1 

Selected Deniogra[4tic Infonnation About ReapcxidaitB to the Oolleqe Student Earorienoe Questionnaire 



School 


Sample 


NUBber of 




Sex 


(%) 




Race (%) 








Class (%) 




N 


Reflpondents 


Rate < %? 


M 


F 


C 


B 


H 


A 


O 


F 


S 


J 


S 


UA-B 


748 


316 


42.3 


36 


64 


80 


16 


1 


3 


1 


18 


15 


24 


44 


Stanford^ 


690 


192 


27.8 


45 


55 


55 


6 


9 


24 


6 


62 


21 


15 


2 


UC, Davis 


1486 


725 


48.8 


39 


61 


42 


14 


22 


16 


5 


22 


23 


24 


30 


Earlhan 


400 


85 


21.3 


37 


63 


94 


2 


1 


1 


1 


35 


22 


27 


17 


Grinnell 


605 


264 


41.8 


47 


53 


83 


3 


2 


9 


4 


16 


51 


17 


16 


loM State 


994 


270 


27.2 


53 


47 


96 


1 


0 


3 


0 


17 


20 


26 


37 


Wichita State 


934 


209 


22.4 


34 


66 


86 


10 


1 


2 


1 


17 


14 


34 


34 


Berea 


398 


236 


59.3 


36 


64 


80 


15 


1 


3 


1 


31 


20 


22 


26 


Louisville 


965 


317 


31.7 


36 


64 


86 


10 


1 


3 


1 


20 


21 


33 


26 


Ftount Holyoke 


396 


180 


45.5 


0 


100 


87 


2 


3 


7 


1 


23 


27 


22 


28 


(HOC 


750 


201 


26.8 


36 


64 


85 


iz 




0 


1 


23 


21 


28 


29 


Miami Univ. 


1000 


538 


53.8 


34 


66 


92 


2 


2 


3 


1 


30 


24 


22 


25 


Xavier Univ." 


120 


68 


34.0 


37 


63 


3 


92 


0 


0 


5 


49 


30 


13 


8 


TOTALS 


9486 


3601 


38.0 


37 


63 


75 


10 


6 


7 


2 


25 


23 


24 


27 
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LefMid for Table 1 



Race: C (caucasion). B (black. African-AiMrican) , H (Hiapanic. Latino. 
Nexican-AMrican) , A (Aaian-Aaarican) , 0 (otbar) 

» 

Stanford: Stanford annually adiiniaters a Senior Survey. Becauae tbe 

Senior Survey *na to be diatributed near the end of the Spring Quarter, 
at about the »mm timm aa the CSifi, it waa afreed that aeniora would not 
be aent the CSIQ . 

Xaviar: The Xavier soaple wmm m convraienca ooqple. Originally, a raodon 
*>>Pl« of Xavier atudmta i#are aent tlia CSfQ aiailar to the aaiiMr in 
which tha inatnaanta i#ara diatributad on tha othar coqpuaaa. Howavar, 
tha raturnad inatruMota wara aiaplacad. Xaviar officiala, wall- 
intantionad, diatributad additional copiaa of tha C^f Q to aalactad 
atudanta. Tha nuabar of inatruMnta diatributad tha aacond tiaa (200) 
ia an aatiaata. 
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1. Alabama 

2. Stanford 

3. Cal-Davia 

4. Earlhan 

5. Grinnell 

6. lam State 

7. Wichita State 

8. Bei«a 

9. Louisville 

10. Bolyoke 

11. woe 

12. Miani 

13. Xavier 



TABU 2 

aamoam vmumbus 



Strwiqth Lcxation Statue 
13 3 
2 2 2 

2 2 2 

3 2 1 
3 11 
2 2 2 

2 3 2 

3 11 
13 2 
3 11 
13 3 
3 13 
3 3 3 



Ethos Philos Multic 



2 2 2 

113 

2 2 3 
112 
113 

3 2 2 
2 2 2 
13 3 
2 2 2 
12 2 

2 2 1 

3 3 1 
3 3 3 
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TMM 3 

EMnCR UnODOB OF 
BSnMMEB OF GKOB 8CKJBS 





PACE 


(1967) 


ALL CASES 


RESIDBfTIAL 




N » 


2543 


N« 3354 


N = 


724 


FMCTGR I 


SELF 


(.82) 


LIT 


(.81) 


SYNIH 


(.74) 


(PERS & SOC) 


aiHERS 


(.77) 


ARTS 


(.69) 




(.67) 




VALUES 


(.69) 


FHUS 


(.64) 


VALUES 


(.64) 




TEM1 


(.54) 


GBQjQ) 


(.60) 


SELF 


(.63) 




HEALTH 


(.50) 


litlTE 


(.56) 


PHILS 


(.63) 












ANALY 


(.60) 












MOTE 


(.58) 












OIBSB 


( .57) 














(.49) 


FACIGR II 


SCI/IECH (.95) 


OIHERS 


( .73) 


TECH 


(.89) 


(Sa & TECB) 


sen 


(.82) 


TEAM 


(.74) 


SCI 


(.87) 




OCKSQ 


(.74) 


SELF 


(.67) 


OONSQ 


(.81) 








HEALTH 


(.66) 


QQANT 


( .68) 








VALUES 


(.62) 






FACTOR III 


LIT 


(.88) 


SCI /TECH 


(.90) 


TEAM 


(.67) 


(ED, LIT & ARTS) 


ARTS 


(.63) 


SCI 


(.88) 


HEALTH 


(.64) 




WRITE 


(.45) 


OONSQ 


(.81) 










(.38) 












PHILS 


(.37) 










FACTOR IV 


ANALY 


(.76) 


SWIH 


(.73) 


VOC 


(.72) 


dNTEIj 3KL) 


swra 


(.69) 


ANALY 


(.73) 


CAREER 


(.67) 




QUANT 


(.61) 




(.64) 


SPEC 


(.54) 




INQ 


(.40) 


QQAKT 


(.54) 


CMPTS 


(.53) 








GMPTS 


(.36) 






FACTOR V 


MX 


(.74) 


VOC 


(.82) 


ARTS 


(.80) 


{VOC EREP) 


CAREER 


(.64) 


CAREER 


(.72) 


LIT 


(.75) 




SPEC 


(.46) 


SPEC 


(.61) 







2^0 



nOE 4 

SUfMOrOP MBMB MD SnmMB) DEVIKTIONS 

caw oniJJCT iMViitiiiiii sckus 





SR- 




0/C- 




C3C0* 


SIA** 






m 


8d 


in 


ad 


in 


ad 


in 


ad 


in 


ad 


in 


ad 


in 


ad 


SCH 


6.5 


0.8 


5.9 


1.1 


5.4 


1.2 


5.5 


1.2 


5.4 


1.2 


6.3 


0.9 


5.7 


1.2 


E3IH 


5.2 


1.4 


4.5 


1.4 


4.5 


1.4 


4.3 


1.4 


4.7 


1.3 


5.1 


1.3 


4.9 


1.3 


CHIT 


6.0 


1.1 


5.4 


1.2 


4.9 


1.3 


5.0 


1.3 


4.9 


1.2 


5.9 


1.1 


5.0 


1.3 


VOC 


4.1 


1.8 


4.6 


1.5 


4.7 


1.5 


4.7 


1.4 


4.8 


1.4 


3.6 


1.6 


5.0 


1.4 


EIMC 


5.0 


1.4 


4.7 


1.4 


4.7 


1.4 


4.6 


1.4 


4.9 


1.3 


4.5 


1.4 


5.2 


1.3 


SID 


5.9 


1.2 


5.4 


1.4 


4.9 


1.6 


5.2 


1.5 


5.5 


1.3 


5.5 


1.3 


5.7 


1.3 


FAC 


5.9 


1.1 


5.0 


1.4 


5.0 


1.5 


4.8 


1.4 


5.3 


1.3 


5.8 


1.1 


5.7 


1.2 


MM 


4.6 


1.5 


4.2 


1.6 


4.0 


1.7 


3.9 


1.7 


4.4 


1.6 


4.5 


'.5 


4.9 


1.6 



a Institutions participating in the College Experiences Study 
b Frora Pace (1987) 



SR - Shall residential institutions 

Ut * Large residential institutions 

U/C * Urban institutions with a hic^ proportion of ccnmuter students 

DO * Doctoral universities 

CCD * Qonfir^iensive colleges and universities 

SLA * Selective liberal arts colleges 

GLA - General liberal arts colleges 
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IIMS 

m—BwiM or miwii run 





8CI 


I8TI 


CIIT 


IOC 


MM 


STI 




IM 


miKTi 


LOCITIOI 


STATIS 


mos 


PIIIOS 


NIITIC 


SCI 
































J) 




























CIIT 


tc 
•H 




























WW* 


•11 




•11 
























Mil* 
rliv 






• 35 


•44 
























1A 


•2B 


•i5 


• • 

.11 


.31 




















nc 




•J5 


• 32 


.It 






















flUH 




« jO 


• 24 


.1/ 






















oTIIVwTI 


11 

• i7 


•lo 


•24 


-.J7 






















UCITIOI 


-.29 


-•15 


-.24 


.08 






-.11 


..u 


.1, 












srim 


-.21 


-•14 


-.22 


.14 












.3i 










mos 


-.21 


-.11 


-.21 


.13 












.11 


.75 








niios 


-.11 


-•11 


-.14 


.19 












-.24 


.43 


.51 






mine 


.14 


•II 


.17 














-.14 


-.44 


-.59 


-.45 
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TNSM 6 



RBORESSKN JMKLSCSIS 

DBranmr >miimu: odicoc^ 

(BBA mOBlS) 



Stanll 
Residential 

754 

0.243 



Large 
Residential 

1685 

0.206 



Urban/ 
OcRRUter 

1065 

0.153 



aCH — 
E8IH 

CRIT 0.22 0.22 0.15 

VOC — 0.12 0.13 

FRMC 0.18 0.10 0.07** 

sra 0.06** 0.17 o.i3 

FAC 0.17 0.10 0.09* 

ADM 0.12 — -- 



SUMMflU — 
LXKHON 

sniDs — 

EIBOS — 

FBmB 0.06** 
MJLTIC 



HXTTCnc = Sura (Estimate of Gains) 

p<.001 unless otherwise indicated 
* p<.05 
** p<0.10 
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RBORBSBIOH MnUCBIS 

ADB Fncsate vs. oqukb BivncNeir 

{BEXh MBIGHTS) 





PERSCNVL/ 


scmicE/ 


TEAM/ 


yxxnnamL 


ARTS i 




INIEIIfCTlAL 




HEALTO 




LITERATI 


N 


746 


741 


746 


V49 


752 




0.251 


0.073 


0.123 


0.223 


0.134 


SCH 


0.08* 














Esn 








0.11* 


-0.10* 


0.10* 


CUT 


0,25 






0.11* 


0.15 


wc 


-0.13 


0.15 


0.08** 


0.23 


-0.14* 


RAC 


0.17 


0.11* 




0.11* 


O.U* 


SIO 


0.07* 




0.12 


0.07** 




EMC 


0.14 


0.10* 




0.19 


0.13 


AIM 


0.09* 




0.19 




0.12* 


STKENUlU 












LOCKnOM 






0.07** 




0.08* 


SXKTOS 












EIBOS 












CHmB 




-0.11* 


0.12* 


0.12* 


0.11* 


MDLTIC 








0.18 





p<.001 unless othetwise indicated 
• p<.05 



p<0.10 



Personal/ = SYNIH & INQ & VALUES & SELF & PfULS & ANALY & 

Intellertual MOTE & CfTfEBS & GBUJD 

Science/ = Sd/TECH & SCI & CX3NSQ & QOATir 
Tedmology 

Team/Health = TEAM & HEALTH 

Vcxational VOC & CAREER & SPEC & CMPTS 

Arts & = ARTS & LIT 

Liter«iture 
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TMU 8 



UBGB HRBJLHriMi 
RBGSBSBUll MMUESIS 

(xna nicKiB vs. ooum Bivnateir 

(BEIA NEIGHIS) 



N 



PESS 

& aoc 

1653 
0.167 



SCI & 
TECH 

1677 

0.083 



ED, LIT 
& ARTS 

1657 

0.202 



INTEL 
SKL 

1648 

0.141 



VDC 
PREP 

1675 

0.184 



9CH 

BSIH 

dtlT 

voc 
Eiac 

SID 
EMC 
ACM 

SIREMC9IH 

LOCKHGN 

SIKEUS 

EIB08 

PHILQS 

MDLTIC 



0.08* 
0.07* 
0.07* 
0.11 

0.27 



0.12 



-0.05** 
0.16 
0.09 



0.06* 



0.17 
0.33 



0.19 
0.13 



0.09 
0.09 



-0.40 
-0.36 



0.25 

0.07* 

0.07* 

0.09 

0.08* 



0.06* 



-O.U 
0.10 
0.27 
0.14 
0.09 
0.09 



0.15 
0.09* 



p<.001 unleaa othervdae indicated 
* p<.05 
** p<0.10 



PE8S & SOC 
Sa & TBCH 
ED, LIT & ARTS - 
INTEL SKL - 
VOC PREP - 



SELF & OTHERS & VALUES & TEAM & HEALTH 
SCI & SCI/TECH & OGNSQ 
GBII£D & LIT & ARTS & fiOTE & PHILS 
ANALY & sunn & QOAOT & INQ & CMPTS 
\^ & CAREER & SPEC 
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FB^SEBBSSM MKUEBIS 
GKENB FimaBS VS. CQUiKB BIVIRCNBir 
(BEIA NEIGBIS) 





PESS 


SCI & 


ED, LIT 


INTEL 




& soc 


1ECH 


& ABTS 


SKL 


If 




XU30 


XU47 






0.153 


0.073 


0.103 


0.103 


SCH 


. — __ 


— — 




0.08* 


ESIH 


0.08* 


-0.10* 


0.17 


-0.14 


CRIT 




0.18 


0.09* 


0.15 


voc 


0.06** 


0.13 




0.09* 


FIAC 


0.09* 






0.08* 


SID 


0.22 


0.08* 




0.09* 


EMC 


0.06** 




0.14 


0.07* 


AEM 










SmBKTtH 


0.16* 




0.10* 




LXKHGN 










STKEUS 


0.10* 


0.07* 


0.07** 




EIH08 
FHILQS 


-0.12* 




-0.10** 




Momc 




0.06* 


0.07** 





VDC 
PREP 

1056 

0.168 



0.09* 
-0 08* 

0.22 
0.14 

0.14 



-0.11* 
0.10* 



p<.001 unless otherwise indicated 
* p<.05 
** EKO.IO 



PERS & SOC 
SCI & TECH 
EDr LIT & ABTS 
SUGL SKL 
VOC PREP 



SELF & OTHERS & VALUES & TEAM & HEALIH 
SCI & SCI/TECH & O0N9Q 
GEKLED & LIT & ARTS & (ftlTE & PHILS 
ANALY & SYNTH & QUANT & INQ & CMFTS 
VOC & CAREER & SPEC 
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APPENDIX A 
CSBQ COLLEGE ENVIRONMENT SCALES 



SCH = Emphasis on the development of academic , scholarly, and 
intellectual qualities. 

ESTH = Emphasis on the development of esthetic, expressive, 
and creative qualities. 

CRIT - Emphasis on being critical, evaluative, and analytical. 

VOC = Emphasis on the development of vocational and 
occupational competency. 

PRAC = Emphasis on the personal relevance and practical values 
of your courses. 

STU * Relationships with other students, student groups, and 
student activities. 

FAC * Relationships with faculty members. 

ADM * Relationships with administration personnel and offices 



ERIC 
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APHNDIX B 
CSBQ ESrotflg OP GMNS SOOBS 



ERIC 



Vocational training — ^acquiring knowledge and skills applicable to 
a specific job or type of %«>rk. 

SPEC Acquiring background and specialization for further education in 

seme professional, scientific, or scholarly field. 

GEMLED Gaining a broad general education about different fields of 

knowledge. 

CAREER Gaining a range of infornation that may be relevant to a career. 

ARTS Developing an understanding and enjoynent of art, nusic, and 

drama. 

LIT Broadening your 'ioquaintanoe and enjoynent of literature. 

tiUTE writing clearly ani effectively. 

CMPTS Aoiuiring familiarity with the use of ocnputers. 

PfULS Becoming aware of different philosophies, cultures, and ways of 

life. 

VALDES Developing your own values and ethical standards. 

SELF Understanding yourself — your abilities, interests, and 

personality. 

orao^ Understanding other people and the ability to get along with 

different kinds of peqple. 

TEAM Ability to function as a team menter. 

HEALTH Developing good health habits and physical fitness. 

SCI Understanding the nature of science and experimentation. 

SCI/TECH Understanding new scientific and technical develofixnents. 

OONSQ S/T Beocming aware of the consequences (benefits/hazards/dangers/ 
values) of iteu applications in science and technology. 

ANALY Ability to think analytically and logically. 

QUANT Quantitative thinking — understanding probabilities, proportions, 

etc. 

SYNIH Ability to put ideas together, to see relationships, 

similarities, and differences between ideas. 

INQ Ability to learn on your own, pursue ideas, and find nformation 

you need. 
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Appendix 16 



END 

U.S. Dept . of Education 

Office of Education 

Research and 
Improvement (OERI ) . 

ERIC 



Date Filmed 
March 29, 1991 
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